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COHMUNICATION APPARATUS, TRANSMISSION APPARATUS 
AND RECEPTION APPARATUS 

BACKGROUND OF THE INVENTION 

The present invention relates to a coinmunication 
apparatus, a transmission apparatus and a reception 
apparatus. More particularly, the present invention relates 
to a communication apparatus, a transmission apparatus and a 
reception apparatus, which are used for transmitting and 
receiving streaming data to and from a network. 

In the past, thoro wore proposed some transmission 
protocols were proposed suitable for transferring video data 
including moving-picture data, audio data and auxiliairy data, 
to a destination by way of a network and streaming to 
reproduce the data in a real-time manner. The RFC 1889 has 
recommended an RTP {Real-time Transport Protocol) , which is 
one of the proposed transmission protocols, as a transport 
protocol for realizing a real-time transport application for 
transmitting/receiving sounds and moving pictures in a real- 
time manner by way of an IP network such as the Internet. 

In general, the RTP is adopted in conjunction with an 
RTCP (Real-time Transport Control Protocol) for controlling 
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the RTP on a UDP (User Datagram Protocol) , which is a 
connectionless protocol. While the RTP is a protocol for 
transmitting sound and moving-picture data, the RTCP is a 
protocol for implementing a function to check information 
such as a transmission delay and €t line quality as well as a 
function to notify an application adopting the RTP of the 
information. For example, an RTCP packet transmitted by a 
sender transferring RTP data includes an SR (Sender Report) 
including a timestamp and the number of transmitted RTP 
packets and an RR (Receiver Report) . On the other hand, an 
RTCP packet transmitted by a receiver of RTP data includes 
an RR including an RTP loss factor, the number of lost RTP 
packets and an average value of jitters of arrival- time gaps. 
For this reason, it is necessary for the transmitter of RTP 
data to manage sender information and receiver information. 
The sender information includes the number of RTP packets 
transmitted in the transmission of the RTP data. On the 
other hand, the receiver information includes the niimber of 
RTP packets lost in the reception of the RTP data. 

Since it is necessary to manage these pieces of 
infojniiation, traditionally, RTP/RTCP communications are 
implemented by carrying out software processing by using a 
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process in a host such as a personal computer. 

In addition, in order to process data at an even 
higher speed, processing to packetize and depacketize data 
by RTP is carried out by using an external apparatus instead 
of executing a process in the host. An example of such an 
external apparatus is data communication hardware connected 
to a PCI bus. For details, refer to patent reference 1 or 
other documents. 

Fig. 24 is a diagram showing the configuration of the 
conventional communication apparatus. The communication 
apparatus shown in the figure is explained as an apparatus 
on the transmission side. In the conventional communication 
apparatus, data generated by an encoder 310 is packetized by 
an RTP process unit 500, and a network device 330 transmits 
the packet to an apparatus on the reception side. The 
processing function of the RTP process unit 500 is 
implemented by software. To be more specific, a control 
unit such as a CPU executes a program of the software. In 
order to transmit an RTP packet to an apparatus on the 
reception side, sender information is recorded in an RTP 
information management database 501 in advance. As a time 
to transmit the RTCP packet to an apparatus on the reception 
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side is reached, the RTCP packet is generated on the basis 
of the sender information, and the network device 330 
transmits the RTCP packet. 

A communication apparatus disclosed in patent 
reference 1 is further connected to an RTP card 610, which 
carries out transmissions and receptions of RTP packets by- 
using hardware. The RTP process unit 500 forms a judgment 
as to which one of w hether the RTP process unit 500 and or 
the RTP card 610 is to transmit-g an RTP packet to an 
apparatus on the reception side. If the RTP process unit 
500 is determined to be the unit to transmit an RTP packet, 
the procedure described above is followed. If the RTP card 
610 is determined to be the unit to transmit an RTP packet, 
on the other hand, the RTP packet is transmitted by updating 
an RTP information management database 611 of the RTP card 
610 in advance. As a time to transmit the RTCP packet to an 
apparatus on the reception side is reached, the contents of 
the RTP information management database 611 are copied to 
the RTP information management database 501 of the host and 
the RTCP packet is generated on the basis of information 
acquired from the RTP information management database 501. 
Then, the RTP card 610 transmits the RTCP packet to an 
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apparatus on the reception side. In processing to receive 
an RTCP packet, data is extracted from the RTCP packet along 
a route opposite to the transmission process described above. 

Next, the RTP process unit 500 is explained in detail. 
Fig. 25 is a diagram showing the configuration of the RTP 
process unit 500 employed in the conventional communication 
apparatus . 

In this case, in accordance with the RFC 22 50, an RTP 
packet having an MPEG- 2 transport stream (referred to 
hereafter simply as an MPEG2-TS) as a pay load is required to 
include an RTP timestamp field in the RTP header aa a field 
having a value synchronized to the data stored in a PGR 
(Program Clock Reference) field of a TS packet, which is 
enclosed in the RTP packet as a portion of the RTP payload. 

In the RTP process unit 500, when a TS packet 
generated by an MPEG-2 encoder 311 is supplied to an encoder 
interface (I/F) 312, the TS packet is passed on to a TS 
header checker 502, which checks the header of the TS packet 
to detect a PGR field. The TS header checker 502 stores the 
detected PGR field in PGR registers 504 and temporarily 
stores the TS packet in a TS buffer 505. A packet 
transmission control unit 503 manages information such as 
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the number of input TS packets. As conditions for a packet 
transmission are all satisfied, the packet transmission 
control unit 503 issues a request for a transmission of an 
RTP packet to a packet synthesis unit 506. At this request, 
the packet synthesis unit 506 generates a timestamp from the 
value of the PGR field stored in the PGR registers 504. The 
packet synthesis unit 506 also generates the RTP packet 
including an RTP payload and an RTP header. The RTP payload 
includes the TS packets stored in the TS buffer 505 and the 
RTP header includes the generated timestamp in the RTP 
timestamp field of the RTP header. 

Patent reference 1: Japanese Patent Laid-open No. 
2001-320407 

However, the conventional communication apparatus has 
a problem of a in that it is difficulty to maintain a 
streaming quality for some states of the conventional 
communication apparatus serving as a host. In addition, the 
conventional communication apparatus has another problem in 
that it is hard to make the scale of the circuit compact in 
order to maintain a predetermined streaming quality. 

As shown in Fig. 24, in the conventional 
communication apparatus, a control unit in the communication 
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apparatus serving as a host carries out the processing to 
packetize and depacketize data in and from an RTCP/RTP 
packet by execution of software. Even if the RTP card 610 
for carrying out the RTP processing is employed as an 
additional unit, the control unit in the host forms a 
judgment as to whether the RTP processing is to be carried 
out by using the software or the hardware. 

For the reason described above, in dependence on the 
processing state of the host or the condition of the network, 
it may be impossible to assure sufficient precision for a 
measured packet arrival time or for a determined timing to 
pass real-time data to a protocol at a higher level. In 
general, in a moaourcmGnt m easuring of a time by using 
software, the arrival of a packet interrupts the host, which 
then carries out an interrupt-handling process to measure a 
time. However, an interrupt latency (defined as a period of 
time between the generation of an interrupt signal and the 
implementation of the interrupt-handling process) of the 
host varies in dependence on the processing state of the 
host. In a reception process, the arrival time of a packet 
must be measured at the precision of an RTP timestamp. By 
the same token, thea timing to pass real-time data to a 
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protocol at a higher level must be determined also at the 
precision of an RTP times tamp. In the case of an MPEG2-TS 
serving as an object of processing, a resolution of 90 KHz 
(or about 11.11 microseconds) is required. Thus, if the 
reception process is entirely carried out by using software, 
in some cases, sufficient precision cannot be assured 
because of reasons such as the fact that the measured time 
and the determined timing lag behind their respective 
correct values. 

If the measured arrival time has a lack of precision, 
it is impossible to estimate a QoS (Quality of Service) on 
the network with a high degree of accuracy. Thus, 
information cannot be reported correctly. As a result, the 
condition of the network cannot be improved on the basis of 
the incorrectly reported information . 

In addition, a communication apparatus on the 
reception side controls a timing to pass data extracted from 
an RTP packet to a protocol at a higher level by referring 
to an RTP timestamp set by the communication apparatus on 
the transmission side in the header of the RTP packet. To 
put it in detail, the data is temporarily stored in the 
buffer and then passed to a protocol at a higher level as 
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soon as thea time obtained as a result of adding jitters to 
an RTP timestamp of the RTF packet is reached. For this 
reason, it is necessary to synchronize a timer employed in 
the communication apparatus on the transmission side to a 
timer employed in the communication apparatus on the 
reception side. As described above, however, it is 
impossible to assure sufficient precision for timings 
determined by the communication apparatus on the 
transmission and reception sides. Thus, thoro io raiood a 
problem is raised in that it is difficult to synchronize the 
timer employed in the communication apparatus on the 
transmission side to the timer employed in the communication 
apparatus on the reception side. Assume for example that 
the timer employed in the communication apparatus on the 
transmission side is proceeding in a manner lagging behind 
the timer employed in the communication apparatus on the 
reception side. In this case, the speed to pass data 
extracted from RTP packets to a protocol at a higher level 
is low with respect to the speed at which the RTP packets 
are received. As a result, an overflow occurs, in a buffer 
for temporarily storing the data. 

Thus, if the measured arrival time has a lack of 
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precision or if the timer for setting an RTP timestamp in 
the communication apparatus on the transmission side is not 
synchronized to the timer for interpreting the same RTP 
timestamp in the communication apparatus on the reception 
side as described above, it is impossible to set thee timing 
to pass data to a protocol at a higher level with a high 
degree of accuracy. Assume for example that the protocol at 
the higher level is a decoder. In this case, a reproduction 
timing of the decoder will be greatly m uch affected by the 
timing to pass data from the RTP process unit 500 to the 
decoder unless a buffer employed in the decoder has a 
sufficiently large size. The quality of the reproduction 
result of the stream data will be greatly m uch affected as 
well. In order to solve this problem, it is necessary to 
provide a margin to the size of the buffer employed in the 
decoder. In this case, however, the circuit will be 
inevitably designed in a wasteful manner. 

On the other hand, i^ n order to synchronize the RTP 
timestamp to the value stored in the PGR field of a TS 
packet received from a protocol at the higher level in the 
apparatus on the transmission side, on the other hand, the 
TS packet is stored in the TS buffer 505 and the value 
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stored in the PGR field is managed by using the PGR 
registers 504. Therefore, the number of TS packets managed 
in the TS buffer 505 is limited to the number of PGR 
registers employed in the PGR registers 504. Since a ratio 
of the number of TS packets each including a PGR field to 
the amount of data passed by the protocol at the higher 
level is dependent on the condition of the protocol at the 
higher level , however , it is difficult to estimate the ratio 
at the design stage. It is therefore necessary to provide a 
margin to the design of the PGR registers 504 and the TS 
buffer 505. In consequence, the circuit will be unavoidably 
designed in a wasteful manner. 

SUMMARY OF THE INVENTION 

It is thus an object of the present invention^ 
addressing the problems described above_j^ to provide a 
communication apparatus capable of maintaining a high 
streaming quality without regard to the processing state of 
the control unit employed in the host. It is another object 
of the present invention to provide a communication 
apparatus allowing the scale of the circuit to be reduced. 

According to the first aspect of the present 
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invention, thoro io provided a communication apparatus is 
provided having a network device connected to a network to 
be used for outputting and receiving packets to and from the 
network, the communication apparatus including: 

time measurement means for measuring a time on the 
basis of a clock signal having a predetermined frequency; 

transmission process means for receiving information 
data from an application at a higher level, packetizing the 
information data, outputting the packet to the network by 
way of the network device and saving sender information 
including a transmission time of the packet; 

reception process means for receiving a predetermined 
packet from the network by way of the network device, 
generating receiver information including an arrival time of 
the packet by using the time measurement means, saving the 
receiver information, depacketizing the packet to obtain 
predetermined information data and outputting the 
predetermined information data to an application at a higher 
level ; and 

data control means for controlling flows of the 

information data. 

According to the second aspect of the present 
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invention, there io provided a transmission apparatus is 
provided having a network device connected to a network to 
be used for output ting a packet to the network, the 
transmission apparatus including: 

transmission process means for receiving information 
data from an application at a higher level, packetizing the 
information data, outputting the packet to the network by 
way of the network device and saving sender information 
showing conditions at a transmission time of the packet; and 

data control means for controlling a flow of the 
information data. 

According to the third aspect of the present 
invention, there ia provided a transmission apparatus is 
provided having a network device connected to a network to 
be used for outputting a packet to the network, the 
transmission apparatus including: 

payload storage means for temporarily storing 
information data received from an application at a higher 
level as a payload of the packet; 

determination means for determining whether or not 
the information data received from the application at a 
higher level includes predetermined attached information to 
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be attached to the packets- 
attached- information storage means for extracting the 
attached information from the information data received from 
the application at a higher level and temporarily keeping 
the attached information if the determination means 
determines that the information data received from the 
application at a higher level includes the attached 
informations- 
control means for allocating an area in the payload 
storage means as an area to be used for storing the attached 
information if the determination means determines that the 
information data received from the application at a higher 
level includes the attached information; and 

attached-information write means for writing the 
attached information kept temporarily in the attached- 
information storage means into the area allocated by the 
control means as an area to be used for storing the attached 
information. 

According to the fourth aspect of the present 
invention, there io provided a reception apparatus is 
provided having a network device connected to a network to 
be used for receiving a packet from the network, the 

14 



SON-2850 (80001-2850) 
REDLINE VERSION 



Patent Application No.: 10/717,631 



reception apparatus including: 

time measurement means for measuring a time on the 
basis of a clock signal having a predetermined frequency; 

reception process means for receiving a predetermined 
packet from the network by way of the network device, 
generating receiver information including an arrival time of 
the packet by using the time measurement means, saving the 
receiver information, depacketizing the packet to obtain 
predetermined information data and outputting the 
predetermined information data to an application at a higher 
level; and 

data control means for controlling a flow of the 
information data. 

In the communication apparatus described above, the 
data control means controls flows of the information data. 
In a transmission process, the data control means passes 
information data received typically from an encoder serving 
as an application at a higher level to the transmission 
process means. When receiving information data to be 
transmitted, the transmission process means packetizes the 
information data, and transmits the packet to the network by 
way of the network device. At that time, the transmission 
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process means generates and saves sender information 
including a transmission time of the packet, 

When receiving a packet from the network by way of 
the network device, the reception process means uses the 
time measurement means to generate receiver information 
including an arrival time of the packet and saves the 
receiver information. In addition, the reception process 
means depacketize the packet to obtain information data and 
then transfers the info3rmation data to typically a decoder 
serving as an application at a higher level. 

The transmission apparatus described above generates 
a packet on the basis of predetermined attached information 
included in information data received from the application 
at a higher level. The information data is kept in the 
payload storage means as a payload till a predetermined 
condition is satisfied. The detection means determines 
whether or not the information data received from the 
application at a higher level includes predetermined 
attached information to be attached to the packet. If the 
detection means determines that the information data 
received from the application at a higher level includes 
predetermined attached information to be attached to the 
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packet, the attached-information storage means extracts the 
attached information from the information data and 
temporarily keeps the attached information, whereas the 
control means allocates an area in the pay load storage means 
as an area to be used for storing the attached information. 
In the payload storage means, the allocated area precedes an 
area used for keeping the information data. Then, the 
attached-information storage means copies the attached 
information kept temporarily in the attached-information 
storage means to the area allocated by the control means 
after an operation to store the information data is 
completed. 

The communication apparatus provided by the present 
invention may include a transmission process means for 
packet i zing information data, a reception process means for 
depacketizing a packet to obtain information data and an 
apparatus control unit for controlling flows of information 
data. The transmission process means and the reception 
process means are capable of carrying out communication 
processing independently of the condition of a load borne by 
the apparatus control unit so that it is possible to assure 
precision in measurement of a network condition and in 

17 



SON-2850 (80001-2850) Patent Application No . : 10/717,631 

REDLINE VERSION 



determination of ar-timing. Thus, the streaming quality can 
be kept at a predetearmined level. In addition, since the 
streaming quality can be assured, a design margin can be 
reduced to a required minimum so that the scale of the 
circuit can be made compact. Moreover, it is also possible 
to decrease the processing load borne by the apparatus 
control unit, which is a unit on the host side. 

In the conventional transmission apparatus, payloads 
are managed by using a storage area while data other than 
the payloads are managed by using registers. With the 
transmission apparatus provided by the present invention, 
however, it is possible to manage both the payloads and the 
other data by using a memory common to the payloads and the 
other data. Thus, the registers can be eliminated and the 
scale of the circuit can^ hence_^ be made compact. 

The above and other objects, features and advantages 
of the present invention will become apparent from the 
following description and the appended claims, taken in 
conjunction with the accompanying drawings in which like 
parts or elements denoted by like reference symbols. 

BRIEF DESCRIPTION OF THE DRAWINGS 
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Fig. 1 is a diagram showing the configuration of a 
communication apparatus implemented by an embodiment of the 
present invention ; 

Fig. 2 is a diagram showing the data structure of an 
RTP packet; 

Fig. 3 is a diagram showing the configuration of an 
RTP transmission process unit employed in the communication 
apparatus implemented by the embodiment of the present 
invention; 

Fig. 4 is a diagram showing the configuration of an 
RTP reception process unit employed in the communication 
apparatus implemented by the embodiment of the present 
invention; 

Fig. 5 is a diagram showing the procedure of 
fluctuation computation carried out by the RTP reception 
process unit; 

Fig. 6 is a block diagram showing the configuration 
of a communication apparatus implemented by a second 
embodiment of the present invention; 

Fig. 7 is a block diagram showing the configuration 
of an RTP reception process unit employed in a communication 
apparatus implemented by a third embodiment of the present 
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inventions- 
Fig. 8 is a block diagram showing the configuration 
of an RTP transmission process unit employed in a 
communication apparatus implemented by a fourth embodiment 
of the present invention; 

Fig. 9 is a diagram showing a procedure of processing 
for a case in which a TS packet having a PGR field is mapped 
onto the beginning of an RTP payload; 

Fig. 10 is a diagram showing a procedure of 
processing for a case in which a TS packet having no PGR 
field is mapped onto the beginning an RTP payload; 

Fig. 11 is a block diagram showing the configuration 
of an RTP transmission process unit employed in a 
communication apparatus implemented by a fifth embodiment of 
the present invention; 

Fig. 12 is a diagram showing the procedure of 
processing to store transmission control information; 

Fig. 13 shows a flowchart representing the entire 
procedure of a transmission process; 

Fig. 14 shows a flowchart representing the processing 
procedure of a first write process; 

Fig. 15 is a diagram showing the state of data stored 
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in a transmission buffer for the first write process; 

Fig. 16 shows a flowchart representing the processing 
procedure of a second write process; 

Fig. 17 is a diagram showing the state of data stored 
in the transmission buffer for the second write process; 

Fig. 18 shows a flowchart representing the processing 
procedure of a third write process; 

Fig. 19 is a diagram showing the state of data stored 
in the transmission buffer for the third write process; 

Fig. 20 shows a flowchart representing the processing 
procedure of a process to store transmission control 
information; 

Fig. 21 is a diagram showing the status of 
information written into the transmission buffer in the 
process to store transmission control information; 

Fig. 22 shows a flowchart representing the processing 
procedure. of a transmission process; 

Fig. 23 is a diagram showing the state of the 
transmission buffer in the transmission process; 

Fig. 24 is a diagram showing the configuration of the 
conventional communication apparatus; and 

Fig. 25 is a diagram showing the configuration of an 
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RTP process unit employed in the conventional communication 
apparatus . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Preferred embodiments of the invention are explained 
by referring to the diagrams as follows. 

First of all, the entire communication apparatus 
implemented by a specific one of the embodiments is 
explained before describing details of the specific 
embodiment in concrete terms . 

Fig. 1 is a diagram showing the configuration of a 
communication apparatus implemented by an embodiment of the 
present invention. The present invention is applied, for 
example, to a communication apparatus of a communication 
system for transferring a stream of video data by adopting 
the RTP/RTCP. 

The communication apparatus provided by the present 
invention includes. an RTP process circuit 100, a host-side 
control unit 200, an encoder 310, a decoder 320 and a 
network device 330. Connected to the encoder 310 for 
encoding video data and the decoder 320 for decoding encoded 
video data, tho RTP proccoo circuit 100 is a component^^ 
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within the RTP process circuit 100, for packetizing video 
data in an RTP packet and depacketizing a packet to obtain 
video data from an RTP packet. Used for controlling the 
entire communication apparatus, the host- side control unit 
200 includes an RTCP process means 210 for managing 
information generated by the RTP process circuit 100 and 
creating, transmitting as well as receiving an RTCP packet. 
Connected to a network, the network device 330 is a 
component for carrying out processing to transmit and 
receive an RTP packet . 

The RTP process circuit 100 is hardware including an 
RTP transmission process unit 110 for transmitting an RTP 
packet, an RTP reception process unit 120 for receiving an 
RTP packet and a timer 130 for measuring time. 

The RTP transmission process unit 110 carries out a 
packetize process to generate an RTP packet by adding an RTP 
header to a transport stream received from the encoder 310. 
The generated RTP packet is delivered to the network device 
330 for transmitting the packet to the network. An RTP 
header includes an RTP times tamp and an RTP sequence number, 
and so forth. The number of transmitted RTP packets and the 
number of transmitted RTP bytes and the like are stored as 
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sender information. 

On the other hand, the RTF reception process unit 120 
checks /processes the RTF header of an RTF packet received 
from the network device 330 and carries out a depacketize 
process to extract a payload from the RTF packet. The 
pay load depacketized from the RTF packet is output to the 
decoder 320. At that time, the timer 130 is used for 
measuring an arrival time and jitters of arrival times are 
computed. Then, receiver information including information 
on jitters of arrival times, the number of received RTF 
packets and the number of lost RTF packets is stored. 

The timer 130 generates a clock signal with a 
frequency required for transmission of video data. 
Typically, the original frequency is higher than the 
eventually required frequency. Thus, the original frequency 
is divided by using a frequency divider such as a 
programmable counter to generate the required frequency. 

Connected to the RTF process circuit 100 by an 
internal bus 220, the host-side control unit 200 controls 
the communication apparatus as a whole and includes an RTCF 
process means 210 for carrying out an RTCF process. 

The RTCF process means 210 is a management -packet 
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process means for transmitting and receiving an RTCP packet, 
which is a management packet representing the condition of 
the network. When a predetermined RTCP transmission time is 
reached, the RTCP process means 210 fetches sender 
information and receiver information from the RTP process 
circuit 100 through the internal bus 220, and generates an 
RTCP packet based on these pieces of information. The RTCP 
process means 210 then supplies the RTCP packet to the 
network device 330 for transmitting the packet to the 
network. The RTCP process means 210 also receives and 
analyzes an RTCP packet from the network device 330. The 
RTCP process means 210 is implemented by software. 

The encoder 310 and the decoder 320 are each an 
application at a level higher than the RTP process circuit 
100. The encoder 310 is a member for encoding information 
such as video data received from a real-time data output 
unit not shown in the figure. On the other hand, the 
decoder 320 is a member for decoding information such as 
video data to be output to a real-time data input unit also 
not shown in the figure. The encoder 310 encodes input 
real-time data received from the real-time data output unit, 
converting the data into a transport stream output to the 
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RTP process circuit 100, which uses the stream as the 
payload of an RTP packet. On the other hand, the decoder 
320 decodes a transport stream received from the RTP process 
circuit 100 and outputs real-time data obtained as a result 
of decoding to the real-time data input unit. 

The network device 330 is an lower level application 
compared to at a lovcl lower than the RTP process circuit 100 
and the RTP process means 210. The network device 330 
carries out processing to transmit and receive RTP as well 
as RTCP packets. 

The operation of the communication apparatus having 
such a configuration is explained as follows. 

When a transport stream generated by the encoder 310 
is supplied to the RTP process circuit 100, the RTP 
transmission process unit 110 is activated. The RTP 
transmission process unit 110 creates an RTP packet by 
adding an RTP header to the transport stream and supplies 
the RTP packet to the network device 330. At that time, 
sender information is generated and stored in the RTP 
transmission process unit 110. 

When an RTP packet is supplied to the RTP reception 
process unit 120 from the network device 330, the RTP 
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reception process unit 120 is activated to check and process 
the RTP header of the RTP packet. Then, the RTP reception 
process unit 120 extracts the payload from the RTP packet 
and supplies the payload to the decoder 320. At that time, 
receiver information is generated and stored in the RTP 
reception process unit 120. 

When an RTCP transmission time is reached, the host- 
side control unit 200 activates the RTCP process means 210. 
The RTCP process means 210 then fetches sender information 
and receiver information from the RTP process circuit 100 
through the internal bus 220, and generates a sender report 
and a receiver report based on these pieces of information 
for an RTCP packet. Then, the RTCP process means 210 adds 
the sender and receiver reports to the RTCP packet, which is 
finally output to the network by way of the network device 
330. 

On the other hand, wW hen an RTCP packet is received 
from the network by way of the network device 330, on the 
other hand, — the host-side control unit 200 acquires a sender 
report and a receiver report from the RTCP packet and 
analyzes the reports. A result of the analysis is used for 
improving the condition of the network. 
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The following description explains the 
configurations of the RTP transmission process unit 110 and 
the RTP reception process unit 120, which are employed in 
the RTP process circuit 100. 

The RTP transmission process unit 110 creates an RTP 
packet by adding an RTP header to audio/video data, which is 
referred to hereafter simply as A/V data, and controls 
transmission of the RTP packet. The RTP transmission 
process unit 110 is further explained by referring to 
diagrams as follows. Fig. 2 is a diagram showing the data 
structure of an RTP packet and Fig. 3 is a diagram showing 
the configuration of the RTP transmission process unit 110 
employed in the communication apparatus implemented by the 
embodiment of the present invention. 

As shown in Fig. 2, an RTP packet includes an RTP 
header 410 and an RTP payload 420. The RTP header 410 
includes a version information field V for storing 
information on a version, a padding field P, an extension 
header field X indicating whether or not a header extension 
exists, a sender CSCR (Contributing Source) count field, a 
marker information field M, a payload type field, a sequence 
niimber field, an RTP timestamp field, an SSRC 
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(Synchronization Source) identifier field and a CSCR 
identifier field. The RTP payload 420 is a field for 
storing a transport stream such as an MPEG2-TS received from 
the encoder 310. 

As shown in Fig. 3, the RTP transmission process unit 
ilO for generating such an RTP packet includes an A/V data 
checker 111, a transmission buffer 112, a packet 
transmission process means 113, a sender information 
register 114 and an RTP header register 115. The A/V data 
checker 111 is a component for checking A/V data received 
from the encoder 310. The transmission buffer 112 is a 
memory for storing the A/V data. The packet transmission 
process means 113 is a component for controlling packet 
transmissions. The sender information register 114 is a 
component for holding sender information. The RTP header 
register 115 is a component for managing an RTP header. 

The A/V data checker 111 checks the validity of the 
A/V data received from the encoder 310 and extracts a PGR 
field including time information from the A/V data. The A/V 
data checker 111 uses the time information to update the 
value of an RTP timestamp. In addition, the A/V data 
checker 111 supplies information such as the size of the A/V 
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data to the packet transmission process means 113. The 
checked A/V data and the RTP timestamp information are 
stored in the transmission buffer 112. The RTP header 
register 115 is used for storing predetermined RTP header 
information excluding the RTP timestamp. When conditions 
for a transmission are satisfied, the packet transmission 
process means 113 creates an RTP packet to be transmitted by 
adding the RTP header to the A/V data read out from the 
transmission buffer 112 based on the RTP header information 
stored in the RTP header register 115. Since the 
predetermined RTP header data read out from the RTP header 
register 115 does not include the RTP timestamp, the RTP 
timestamp according to the extracted value of the PGR field 
is read out from the transmission buffer 112 and used as the 
RTP timestamp in the RTP header. The RTP packet created in 
this way is then supplied to the network device 330 for 
outputting the packet to the network. At a transmission 
time, sender information necessary for a sender-report field 
of a RTCP packet is generated and stored in the sender 
information register 114. The sender information includes 
the nximber of transmitted packets and a transmission octet 
count . 
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Next, the RTP reception process unit 12 0 is explained. 
Fig. 4 is a diagram showing the configuration of the RTP 
reception process unit 120 employed in the communication 
apparatus implemented by the embodiment of the present 
invention. 

As shown in the figure, the RTP reception process 
unit 120 includes a reception buffer 121, a queue 122, a 
receiver information register 123, an RTP header checker 124, 
a reception control means 125 and a decoder I/F 126. The 
reception buffer 121, the queue 122 and the receiver 
information register 123 form a storage unit whereas the RTP 
header checker 124, the reception control means 125 and the 
decoder I/F 126 compose a processing unit. The reception 
buffer 121 is a memory for storing the payload of an RTP 
packet received from the network device 330. The queue 122 
is a component for storing information on the RTP packet. 
The receiver information register 123 is a component for 
storing receiver information for the reception of the RTP 
packet. The RTP header checker 124 is a component for 
separating the RTP header from the RTP packet and checking 
the RTP header. The reception control means 125 is a 
component for controlling a reception process. The decoder 
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I/F 126 is a component for outputting the RTP payload to the 
decoder 320. In an operation carried out by the reception 
control means 125,. the timer 130 for RTP processing is 
referred to. 

First of all, the storage unit is explained to be 
followed by a description of the processing unit. 

The reception buffer 121 is used for storing the 
payload of an RTP packet which has passed an inspection 
carried out by the RTP header checker 124. 

The queue 122 has a plurality of storage areas each 
used for storing information on an RTP packet. The storage 
areas are managed by using indexes . The information on an 
RTP packet includes the header of the RTP packet, the start 
address of the payload included in the RTP packet and the 
data length of the RTP packet. As described above, the 
payload is stored in the reception buffer 121. 

The receiver information register 123 is used for 
storing information necessary for filling up the receiver- 
report field of an RTCP packet. The infojrmation includes 
the number of received RTP packets, information on 
fluctuations of network jitters and the number of lost RTP 
packets and the like. 
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The RTP header checker 124 checks the header of a 
packet received from the network device 330 to form a 
judgment as to whether or not the received packet is an RTP 
packet. If the RTP header checker 124 finds out that the 
received packet is an RTP packet, the RTP header checker 124 
separates the RTP packet into the RTP header and the pay load, 
which are then supplied to the reception control means 125. 

The reception control means 125 includes a management 
means 1251, a measurement means 1252 and a timing generation 
means 1253. The management means 1251 is a component for 
managing an order of packets by using the queue 122, The 
measurement means 1252 is a component for measuring 
fluctuations of network jitters by using the timer 130. The 
timing generation means 1253 is a component for measuring a 
timing to output data to the decoder 320 by using 
information stored in the queue 122 and the timer 130. 

The management means 1251 stores a payload received 
from the RTP header checker 124 in the reception buffer 121 
and records the start address, data length along with the 
RTP header. To be more specific, the start address, the 
data length and the RTP header are stored in a queue storage 
area indicated by an index corresponding to a sequence 
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number assigned to the RTP packet. That is to say, the RTF 
packet has a sequence number next to the sequence number of 
an RTP packet output last to the decoder 320 and the index 
is incremented in accordance with the sequence number. The 
management using the queue 122 allows RTP packets arriving 
at incorrect times due to effects of the network to be 
rearranged into a correct order or the same RTP packet 
received for the second time to be discarded. In addition, 
a counter is provided, and every time packet data is 
received, the count value of a counter is incremented to 
count the number of received RTP packets. The number of 
received RTP packets is stored in the receiver information 
register 123. 

The measurement means 1252 computes fluctuations of 
network jitters by using the values of the timer 130 for RTP 
processing and the RTP timestamps of RTP packets. The 
result of the computation is stored in the receiver 
information register 123. 

The timing generation means 1253 acquires the RTP 
timestamp of an RTP packet with thea smallest sequence 
number among RTP packets stored on the queue 122, and 
compares the RTP timestamp with the value of the timer 130 
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for RTP processing. If they match each other, thea timing 
is determined to be normal. With this timing) the timing 
generation means 1253 gives an instruction to the decoder 
I/F 126 to read out data from the reception buffer 121. At 
that time, the sequence number of the RTP packet, whose 
payload is read out by the decoder I/F 126 from the 
reception buffer 121, is saved to be compared with the 
transmission nximbers of RTP packets with their payloads 
currently being transferred and previously transferred to 
the decoder 320. A result of the comparison is used for 
analyzing the state as to how many RTP packets have been 
lost. If an RTP packet is determined to have been lost, a 
corresponding area of the receiver information register 123 
is updated. 

In accordance with the instruction issued by the 
reception control means 125 to read out data from the 
reception buffer 121, the decoder I/F 126 reads out as much 
data of a transport stream as specified from the reception 
buffer 121, starting from a specified address and transfers 
the data to the decoder 320. 

. The computation of fluctuations of network jitters is 
explained as follows. Fig. 5 is a diagram showing the 



SON-2850 (80001-2850) Patent Application No. : 10/717,631 

REDLINE VERSION 

procedure of the fluctuation computation carried out by the 
RTP reception process unit 120. The measurement means 1252 
has a Ttxold register, a Trxold register, a Ttxnew register 
and a Trxnew register. The Ttxold register is a register 
for storing an RTP timestamp of an RTP packet received 
previously. The Trxold register is a register for storing a 
time at which the RTP packet including the RTP timestamp was 
received previously. The Ttxnew register is a register for 
storing an RTP timestamp of an RTP packet received presently. 
The Trxnew register is a register for storing a time at 
which the RTP packet including the RTP timestamp is received 
presently. When an RTP packet is received, an RTP timestamp 
included in the RTP header of the RTP packet is copied to 
the Ttxnew register and an arrival time according to the 
timer 130 is copied to the Trxnew register. As described 
above, an RTP timestamp included in the RTP header of the 
RTP packet received previously is stored in the Ttxold 
register whereas the arrival time computed in accordance 
with the timer 130 for this RTP packet is stored in the 
Trxold register. 

In accordance with RTP specifications (RFC) , a 
fluctuation is represented by the following expression: 
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(Ttxold - Trxold) - (Ttxnew - Ttxnew) (1) 

As described above, the RTP process circuit 100 
provided separately from the host-side control unit 200 
independently processes an RTP packet. It is thus possible 
to provide a coitimunication apparatus capable of carrying out 
a streaming process without being affected by the condition 
of the load borne by the host-side control unit 200. 

In particular, on the reception side, processes to 
detect duplication of a packet, rearrange the order of 
packets and determine a timing to transfer a payload to the 
decoder 320 are carried out by using hardware. In addition, 
computation of fluctuations of network jitters can now be 
kept at the precision of a system clock signal. Thus, a 
detailed report can be obtained without losing the streaming 
stability and lowering the streaming quality. Moreover, 
since the timing to supply A/V data to the decoder 320 is 
accurate, it is not necessary to deliver the A/V data to the 
decoder 320 in advance. As a result, the decoder 320 is 
capable of reproducing the received A/V data with a high 
degree of stability by using a buffer with a small storage 
capacity. 

The communication apparatus described above has both 
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the transmission and reception functions. However, it is 
possible to conceive a communication apparatus, which is 
provided with only one of the functions in order to make the 
apparatus compact. In the case of a receiver, for example, 
only the RTP reception process unit 120 may be provided. In 
addition, it is also possible to conceive a configuration 
without the RTCP process means 210, which is used mainly for 
improving the condition of the network. 

Moreover, as described above, the RTP reception 
process unit 120 employed by the communication apparatus on 
the reception side determines a timing to output data of a 
received RTP packet to the decoder 320 by referring to an 
RTP timestamp included in the RTP header of the RTP packet. 
For this reason, it is necessary to synchronize the RTP 
timer 130 used by the communication apparatus on the 
transmission side with the RTP timer 130 used by the 
communication apparatus on the reception side. Since the 
RTP timer 130 varies from apparatus to apparatus, however, 
there is a discrepancy between the RTP timer 130 used by the 
communication apparatus on the transmission side and the RTP 
timer 130 used by the communication apparatus on the 
reception side. If the RTP timer 130 used by the 
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communication apparatus on the transmission side is 
proceeding fast with respect to the RTP timer 130 used by 
the communication apparatus on the reception side, for 
example, the RTP reception process unit 120 employed by the 
communication apparatus on the reception side has to wait 
longer till a period of time equal to the s\im of a timestamp 
of the transmission side and jitters lapses. For this 
reason, a large number of RTP packets must be held 
internally in the communication apparatus on the reception 
side. On the other hand, i^ f the RTP timer 130 used by the 
communication apparatus on the transmission side is 
proceeding slowly with respect to the RTP timer 130 used by 
the communication apparatus on the reception side,- on the 
other hand, — a relation, which indicates that a time equal to 
the sum of the timestamp included in a received packet and 
jitters leads ahead of the present time indicated by the RTP 
timer 130 on the reception side, may hold true in some cases. 
Also in such a case, data is supplied to the decoder 32 0 at 
a delayed time. In addition, the time delay increases with 
the lapse of time. If there is a discrepancy between the 
RTP timer 130 used by the communication apparatus on the 
transmission side and the RTP timer 130 used by the 
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coiranunication apparatus on the reception side as described 
above, the speed to transfer data to the decoder 320 
decreases, leading to deterioration of the streaming quality. 

In order to solve the problem described above, in a 
second embodiment of the present invention, the RTP 
reception process unit 120 is provided with a means for 
synchronizing the RTP timers 130. Fig. 6 is a block diagram 
showing the configuration of a communication apparatus 
implemented by the second embodiment of the present 
invention. 

A transmission-side communication apparatus 101 is 
provided with the RTP transmission process unit 110 shown in 
Fig. 3 and a transmission-side RTP timer 131. The RTP 
transmission process unit 110 sets an RTP timestamp 
generated on the basis of time information indicated by the 
transmission-side RTP timer 131 in the RTP header of an RTP 
packet 400. Then, the transmission-side communication 
apparatus 101 transmits the RTP packet 400 to a reception- 
side communication apparatus 102 . 

The reception-side communication apparatus 102 is 
provided with the RTP reception process unit 120 shown in 
Fig. 4. However, the RTP reception process unit 120 has an 
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embedded correction means 127. In the RTP reception process 
unit 120, the pay load of the RTP packet 400 received from 
the transmission-side communication apparatus 101 is stored 
in the reception buffer 121. A reception-side RTP timer 132 
measures a time equal to the sum of a transmission timestamp 
included in the RTP packet 400 and jitters. As this time is 
reached, the payload stored in the reception buffer 121 is 
output to the decoder 320. 

The correction means 127 fetches the transmission 
timestamp from the received RTP packet 400 and computes a 
difference between the timestamp and the value of the 
reception-side RTP timer 132. If the difference is foun d to 
be greater than a predetermined value, the reception-side 
RTP timer 132 is newly reset at the transmission timestamp 
included in the RTP packet 400. 

As described above, in the second embodiment of the 
present invention, when the transmission- side RTP timer 131 
is out of not synchronize dation with the reception- side RTP 
timer 132, the value of the reception-side RTP timer 132 is 
automatically corrected to eliminate the discrepancy. As a 
result, the synchronization between the transmission-side 
RTP timer 131 and the reception-side RTP timer 132 can be 
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assured so as to sustain the streaming stability and the 
streaming high quality. 

In addition, in general, when the communication 
system is started up from an initial state, the 
transmission-side communication apparatus 101 and the 
reception-side communication apparatus 102 carry out a 
process to synchronize the transmission-side RTP timer 131 
with the reception-side RTP timer 132. Thus, in the 
communication apparatus provided by the present invention, 
the RTP reception process unit 120 is capable of measuring 
the arrival time of an RTP packet with a high degree of 
precision. By utilizing this measured arrival time, the RTP 
reception process unit 120 is capable of setting the 
reception-side RTP timer 132 on the reception side with ease. 

Fig. 7 is a block diagram showing the configuration 
of an RTP reception process unit employed in a communication 
apparatus implemented by a third embodiment of the present 
invention. Components identical with their counterparts 
shown in Fig. 4 are denoted by the same reference numerals 
as the counterparts. 

The RTP reception process unit employed in a 
communication apparatus implemented by the third embodiment 
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further has a time information generation means 128 in 
addition to the components employed in the RTP reception 
process unit 120 shown in Fig. 4. 

In the case of the third embodiment, the reception- 
side RTP timer 132 has a clock oscillator 1321 for 
generating an original clock signal with a predetermined 
frequency and a frequency divider 1322 for generating 
another clock signal with a desired frequency by dividing 
the predetermined frequency of the original clock signal. 

The time information generation means 128 includes a 
timer initialization means 1281, a timestamp initial value 
register 1282 and a payload information register 1283. The 
timer initialization means 1281 is a component for 
initializing the reception-side RTP timer 132. The 
timestamp initial value register 1282 is a register for 
storing the timestamp included in a received RTP packet. 
The payload information register 1283 is a register for 
storing the type of the payload. 

At an initialization time, an initial RTP packet 401^ 
passing an inspection carried out by the RTP header checker 
124^ is supplied to the time information generation means 
128. The timer initialization means 1281 stores the RTP 
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timestamp included in the RTP header of the RTF packet 401 
into the timestamp initial value register 1282 and the type 
of the payload included in the RTP packet 401 into the 
payload information register 1283. The timer initialization 
means 1281 then activates the frequency divider 1322. Then, 
by referring to the payload information, the frequency 
divider 1322 divides the frequency of the clock signal 
generated by the clock oscillator 1321 to output time 
information at a frequency suitable for the type of the 
payload. An example of the time information is a count 
value. An adder 1284 adds the value output by the frequency 
divider 1322 to an initial value stored in the timestamp 
initial value register 1282 to get an addition result equal 
to the sum of the RTP timestamp on the transmission side and 
a network delay of the initially received RTP packet. If 
the network delay is minimized, the addition result is 
almost equal to the RTP timestamp on the transmission side. 

Since the RTP reception process unit 12 0 is activated 
upon reception of an initial RTP packet without a delay, the 
reception-side RTP timer 132 can be synchronized to the 
transmission-side RTP timer 131 by using the RTP timestamp 
of the initial RTP packet. 
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As described above, in the present invention, RTP 
transmission and reception processes, which used to be 
supported by software of the control unit on the host side, 
are supported by hardware capable of operating independently 
of the- control unit on the host side. In addition, since 
the processing on the host side is now limited to RTCP- 
packet processing, which does not need to be carried out in 
a real-time manner, the load borne by the host can thus be 
reduced. 

Therefore, a predetermined streaming quality can be 
sustained without regard to the state of the load borne by 
the host. In particular, in a reception process, network 
conditions such as the arrival time of a packet and a 
network delay can be measured at the system clock resolution 
and, in addition,— a timing to output data to the decoder 320 
can also be determined at the system clock resolution. As a 
result, the scale of the circuit can be made compact by, for 
example, reducing the storage capacity of the buffer 
employed in the decoder 320. 

In an operation to create a packet, there are some 
cases in which additional information generated on the basis 
of predetermined information data included in a transport 
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stream as a payload must be attached to the packet, 
requiring that a processing mechanism for attaching the 
additional information to the packet be provided. For 
example, a communication apparatus for processing an RTP 
packet including an MPEG2-TS as a payload is provided with a 
register for storing a PGR field value used for 
synchronizing the RTP timestamp of the RTP packet being 
processed to the PGR field. The communication apparatus is 
also provided with a buffer for storing the RTP packet. The 
storage capacity of the buffer is set at a value allowing 
for a design margin. By eliminating the design margin, the 
scale of the circuit can be made even more compact. 

In the case of the present invention, the additional 
information attached to a packet and managed by using a 
register is now managed by using a storage area used also 
for storing the transport stream. Thus, the register can be 
eliminated. 

The following description explains an embodiment 
wherein, in order to synchronize the RTP timestamp of an RTP 
packet with the PGR field of an MPEG2-TS, the PGR field 
value, which used to be managed by using a register is 
managed by using a storage area also used for storing the 
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RTP packet. The description begins with an explanation of a 
fourth einbodiment implementing a communication apparatus, 
which manages PGR fields and an RTP packet by using a 
storage area common to both the PGR fields and the RTP 
packet. Fig. 8 is a block diagram showing the configuration 
of the RTP transmission process unit 110 employed in the 
communication apparatus implemented by the fourth embodiment 
of the present . invention. Gomponents identical with their 
counterparts shown in Figs. 1 and 3 are denoted by the same 
reference numerals as the counterparts. 

The RTP transmission process unit shown in Fig. 8 
includes an A/V data checker 111, a TS buffer 112a and a 
packet transmission process means 113. The A/V data checker 
111 is a component for inputting an MPEG2-TS from the 
encoder 310, inspecting the input MPEG2-TS and then storing 
the inspected MPEG2-TS into the TS buffer 112a. The TS 
buffer 112a is a memory for storing a PGR value in addition 
to the data of the MPEG2-TS. The packet transmission 
process means 113 is a component for adding an RTP header to 
information data set in the TS buffer 112a to create an RTP 
packet and transmitting the RTP packet. 

The A/V data checker 111 includes a TS header checker 
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1111, a TS data controller 1112, a PGR data controller 1113 
and a selector 1114. The TS header checker 1111 is a 
component for checking a TS header. The TS data controller 
1112 is a component for controlling an operation to write 
the data of a TS packet into the TS buffer 112a. The PGR 
data controller 1113 is a component for controlling an 
operation to write PGR data into the TS buffer 112a. The 
selector 1114 is a component for selecting data output by 
the TS data controller 1112 or the PGR data controller 1113 
as data to be written into the TS buffer 112a. 

The TS header checker 1111 checks the validity of the 
input MPEG2-TS and searches the header of the TS packet for 
a PGR field- If a PGR field is found, the TS header checker 
1111 stores the value of the PGR field in a PGR temporary 
register 1113a (see Fig. 9) employed in the PGR data 
controller 1113. The TS header checker 1111 also writes 
data of a TS packet passing the validity inspection into a 
TS temporary register 1112a (see Fig. 9) employed in the TS 
data controller 1112. In addition, the TS header checker 
1111 supplies information, such as the data length of the TS 
packet, to be referred to in managing the boundaries of the 
TS packet stored in the TS buffer 112a to the packet 
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transmission process means 113 . 

The TS data controller 1112 includes the TS temporary 
register 1112a for temporarily storing TS data and a TS 
controller 1112b (see Fig. 9) for controlling an operation 
to write the TS data into the TS buffer 112a. The TS 
controller 1112b controls an operation to write the data of 
the TS packet, which has been stored temporarily in the TS 
temporary register 1112a by the TS header checker 1111, from 
the register 1112a into the TS buffer 112a. 

By the same token, the PGR data controller 1113 
includes a PGR temporary register 1113a for temporarily 
storing PGR data and a PGR controller 1113b (see Fig. 9) for 
controlling an operation to write the PGR data into the TS 
buffer 112a. The PGR controller 1113b stores the PGR data 
at a predetermined location in the TS buffer 112a. 

The selector 1114 selectively accepts a request made 
by the TS data controller 1112 to write TS data into the TS 
buffer 112a or a request made by the PGR data controller 
1113 to write PGR data into the TS buffer 112a. 

The TS buffer 112a is a dual-port RAM used for 
storing TS packets to serve as the payload of an RTP packet 
as well as used for storing PGR values. 
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The packet transmission process means 113 includes a 
packet transmission controller 1131 and a packet synthesizer 
1132. The packet transmission controller 1131 is a 
component for determining a timing to transmit a packet. 
The packet synthesizer 1132 is a component for enclosing the 
MPEG2-TS stored in the TS buffer 112a in an RTF packet and 
outputting the RTF packet. The embodiment shown in Fig. 8 
does not include the sender information register 114 and the 
RTF header register 115, which are employed in the 
embodiment shown in Fig . 3 . 

On the basis of information acquired from the TS 
header checker 1111, the packet transmission controller 1131 
manages boundaries in mapping the data of a TS packet onto 
an RTF payload stored in the TS buffer 112a. As soon as 
conditions are altogether satisfied, the packet transmission 
controller 1131 issues a request for a transfer of an RTF 
packet to the packet synthesizer 1132. The request for a 
transfer of an RTF packet includes a read start address and 
a read data length and the like. The read start address is 
the start address of an area in the TS buffer 112a. The 
packet synthesizer 1132 reads out data of a TS packet from 
the area and adds an RTF header to the data to generate the 
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RTP packet- Then, the packet synthesizer 1132 transfers the 
RTF packet to the network device 330. 

In order to synchronize an RTP timestamp to a PGR 
field, it is necessary to abide by the following rules. 

(1) : An RTP payload shall not include a plurality of TS 
packets each having a PGR field. 

(2) : An RTP payload may include no TS packet having a PGR 
field. 

(3) : A TS packet having a PGR field shall be placed at the 
beginning of an RTP payload, 

(4) : If a current RTP payload does not include a TS packet 
having a PGR field, the RTP timestamp of an immediately 
preceding RTP packet is used as the RTP timestamp of the 
current RTP payload. 

TS packets are arranged in the TS buffer 112a by 
following the rules described above. 

By referring to diagrams, the following description 
explains buffering and writing processes carried out by the 
TS data controller 1112 and the PGR data controller 1113 to 
temporarily keep data of a PGR field in the PGR temporary 
register 1113a and transfer the PGR data from the register^ 
1113a to the TS buffer 112a. Fig. 9 is a diagram showing a 
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procedure of processing for a case in which a TS packet 
having a PGR field is mapped onto the beginning of an RTP 
payload. On the other hand. Fig. 10 is a diagram showing a 
procedure of processing for a case in which a TS packet 
having no PGR field is mapped onto the beginning an RTP 
payload. 

The TS header checker 1111 writes the data of a TS 
packet passing the inspection carried out by the TS header 
checker 1111 into the TS temporary register 1112a. If the 
TS packet includes a PGR field, the TS header checker 1111 
stores the data of the PGR field into the PGR temporary 
register 1113a. 

If an input TS packet includes a PGR field, rule (3) 
is applied to the packet to map the packet onto the 
beginning of an RTP payload. By the way, if an immediately 
preceding RTP payload happens to end with a TS packet 
immediately preceding the current packet, the current TS 
packet is also mapped onto the beginning of the current RTP 
payload even if the current TS packet does not include a PGR 
field unlike the current TS packet described above. As 
described above, Fig. 9 is a diagram showing a procedure of 
processing for a case in which a current TS packet having a 
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PGR field is mapped onto the beginning of an RTP payload. 
In the case shown in Fig. 9, so far, a PGR field has been 
stored in an area 1121 of the TS buffer 112a and previous TS 
packets composing an immediately preceding RTP payload have 
been mapped onto an area 1122 of the TS buffer 112a. Then, 
when the header of a current TS packet is supplied to the TS 
temporary register 1112a employed in the TS data controller 
1112, the TS controller 1112b of the TS data controller 1112 
examines the header to form a judgment as to whether or not 
the header includes a PGR field. If the header includes a 
PGR field, the current and subsequent TS packets are 
sequentially written into the TS buffer 112a, beginning at 
an address obtained by adding an offset equal to the length 
of a PGR field to be stored in an area 1123 in the TS buffer 
112a to the last address of the immediately preceding RTP 
payload, which was mapped onto the area 1122. At a point of 
time the operation to write the current TS packet into an 
area 1124 in the TS buffer 112a is completed, the PGR 
controller 1113b employed in the PGR data controller 1113 
writes a PGR value from the PGR temporary register 1113a of 
the PGR data controller 1113 to the area 1123. 

As is obvious from the above description, in the TS 

53 



SON-2850 (80001-2850) Patent Application No.: 10/717,631 

REDLINE VERSION 

buffer 112a, the current TS packet mapped onto the area 1124 
is delimited from a group of previous TS packets forming the 
immediately preceding RTP pay load mapped onto the area 1122 
by a PGR field, which was included in the current TS packet 
but is now stored in the area 1123. The PGR field stored in 
the area 1121 is the timestamp of the immediately preceding 
RTP packet including the group of previous TS packets 
composing the immediately preceding RTP payload mapped onto 
the area 1122, which has an address higher than the address 
of the area 1121. By the same token, the PGR field stored 
in the area 1123 is the timestamp of the current RTP packet 
including the current TS packet mapped onto the area 1124 
having an address higher than the address of the area 1123 
as the first TS packet at the beginning of the payload of 
the current RTP packet. 

As described above, Fig. 10 is a diagram showing a 
procedure of processing for a case in which a TS packet 
having no PGR field is mapped onto the beginning an RTP 
payload. In the case shown in Fig. 10, a TS packet 
immediately preceding the current packet has been mapped 
onto an area 1125 in the TS buffer 112a as a packet ending 
the immediately preceding RTP payload. In this case, the TS 
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controller 1112b employed in the TS data controller 1112 
writes the current and subsequent TS packets sequentially 
into the TS buffer 112a, beginning at the next address of 
the immediately preceding TS packet, which was mapped onto 
the area 1125, without regard to whether or not the current 
TS packet temporarily stored in the TS temporary register 
1112a employed in the TS data controller 1112 includes a PGR 
field. 

As described above, in the RTP transmission process 
unit 110, PGR values are managed by using the TS buffer 112a 
instead of using the PGR temporary register 1113a, which 
serves merely as a temporary register for storing the value 
of a PGR field. Since values of PGR fields are not stored 
in registers prior to transfers of RTP packets to the 
network device 330, the number of such registers can be 
reduced. In addition, since an operation to estimate the 
rate of data coming from the encoder 310 is easier to carry 
out then an operation to predict the rate of appearances of 
PGR fields in the data, a proper size of the TS buffer 112a 
can be set, allowing all components composing the circuit to 
be used efficiently. 

In addition to the management of PGR fields by using 
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the TS buffer 112a as described above, control information 
for RTP transmissions can also be managed by using a buffer. 
The following description explains a fifth embodiment 
implementing a communication apparatus in which transmission 
control information and packets are managed by using a 
storage area common to the information and the packets. Fig. 
11 is a block diagram showing the configuration of the RTP 
transmission process unit employed in the communication 
apparatus implemented by the fifth embodiment of the present 
invention. Components identical with their counterparts 
shown in Figs. 1, 3 and 8 are denoted by the same reference 
numerals as the counterparts. 

The difference between the RTP transmission process 
unit employed in the fifth embodiment shown in Fig. 11 and 
that employed in the fourth embodiment shown in Fig. 8 is 
the packet transmission controller. To be more specific, in 
the case of the fourth embodiment, the packet transmission 
controller 1131 is included inside the packet transmission 
process means 113 and used for determining a timing to 
transmit an RTP packet. The packet transmission controller 
1131 issues a request for a transmission of an RTP packet to 
the packet synthesizer 1132 with such a determined timing. 
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In the case of the fifth embodiment, on the other hand, a 
packet transmission controller 1115 is employed in the A/V 
data checker 111 to be used as a means for writing control 
information for transmissions into the TS buffer 112a. The 
packet synthesizer 1132 transfers RTP packets to the network 
device 330 by referring to the control information. 

Much like the packet transmission controller 1131 
employed in the fourth embodiment shown in Fig. 8, the 
packet transmission controller 1115 manages boundaries used 
in mapping TS packets onto an RTP payload in the TS buffer 
112a on the basis of infoimation received from the TS header 
checker 1111. As soon as conditions are altogether 
satisfied, the packet transmission controller 1115 writes a 
request to transmit transmission control information of an 
RTP packet into the TS buffer 112a. The- packet synthesizer 
1132 is monitoring the TS buffer 112a to detect a request 
for a transfer of an RTP packet to the network device 330 in 
the transmission control information. As such a request is 
detected, the RTP packet is transferred to the network 
device 330 in accordance with the transmission control 
information stored in the TS buffer 112a. 

The following description explains buffering and 
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writing operations carried out by each of the packet 
transmission controller 1115, the TS data controller 1112 
and the PGR data controller 1113. Fig. 12 is a diagram 
showing the procedure of processing to write transmission 
control information into the TS buffer 112a. Elements 
identical with their respective counterparts shown in Fig. 9 
are denoted by the same reference numerals as the 
counterparts and the explanation of the identical elements 
is not given. 

The TS data controller 1112 writes a current TS 
packet mapped onto the beginning of an RTP payload into the 
TS buffer 112a, starting at an address obtained by adding an 
offset, which is equal to the sum of the length of a PGR 
field to be stored in an area 1123 in the TS buffer 112a and 
the length of transmission control information to be stored 
in an area 112 6 in the TS buffer 112a, to the last address 
of an area for storing the immediately preceding TS packet. 
The PGR data controller 1113 then stores the value of the 
PGR field into the area 1123. 

At thee point of time when the operation to store 
the current and all subsequent TS packets composing the same 
RTP payload in the TS buffer 112a starting at an area 1124 
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is completed, the packet transmission controller 1115 writes 
the transmission control information in the area 1126. 
Typically, the transmission control information includes a 
transmission request flag and the size of an RTP packet to 
be transmitted. The size of an RTP packet to be transmitted 
is the number of bytes of all TS packets composing the RTP 
pay load included in the RTP packet. As an alternative, the 
packet transmission controller 1115 writes the transmission 
control information in the area 1126 prior to the operation 
to store the current and all subsequent TS packets composing 
the RTP payload in the TS buffer 112a, In this case, the 
size of an RTP packet included in the transmission control 
information in the area 1126 is updated every time a TS 
packet of the RTP payload is stored in the TS buffer 112a. 
At thea point of time when the last TS packet of the RTP 
payload is stored in the TS buffer 112a, the transmission 
request flag may be set. 

The following description explains operations of the 
RTP transmission process unit having such a configuration in 
detail by referring to the diagrams. Fig. 13 shows a 
flowchart representing the entire procedure of the 
transmission process. In this case, it is assumed that the 
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PGR field is included in a 6-byte area at the beginning of a 
TS packet, and the TS packet has a length of 188 bytes. 

The processing procedure represented by the flowchart 
shown in Fig. 13 is started when the encoder 310 supplies a 
TS packet to the RTP transmission process unit. The 
processing procedure begins with a step SOI at which the 6 
bytes at the beginning of the TS packet are fetched. 

Then, the flow of the processing procedure goes on to . 
a step S02 to form a judgment as to whether or not the 6 
bytes include a PGR field. If the 6 bytes do not include a 
PGR field, the flow of the processing procedure goes on to a 
step S04. If the 6 bytes include a PGR field, on the other 
hand, the flow of the processing procedure goes on to a step 
S03 to form a judgment as to whether or not the received TS 
packet is the first TS packet received since the most recent 
transmission control information was stored in the TS buffer 
112a. Transmission control information is stored in the 
next area in the TS buffer 112a in an operation carried out 
at a step S07 to write the transmission control information 
into the TS buffer 112a when a request for a transmission of 
an immediately preceding RTP packet is made as will be 
described in detail later. If the received TS packet is the 
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first TS packet received since the most recent transmission 
control information was stored in the TS buffer 112a, the 

flow of the processing procedure goes on to a step SOS. If 
the received TS packet is not the first TS packet received 
since the most recent transmission control information was 
stored in the TS buffer 112a, on the other hand, the flow of 
the processing procedure goes on to a step S06. 

At the step S04, a first write process is carried 
out to store the TS packet including no PGR field into the 
TS buffer 112a. Then, after the first write process is 
completed, the flow of the processing procedure goes on to 
the step S07. 

At the step SOS, a second write process is carried 
out to store the TS packet and a PGR field included in the 
TS packet into the TS buffer 112a- The TS packet is the 
first TS packet received since the most recent transmission 
control information was stored in the TS buffer 112a. Then, 
after the second write process is completed, the flow of the 
processing procedure goes on to the step S07 . 

At the step S06, a third write process is carried 
out to store the TS packet and a PGR field included in the 
TS packet into the TS buffer 112a. The TS packet is not the 

61 



SON-2850 (80001-2850) Patent Application No. : 10/717,631 

REDLINE VERSION 

first TS packet received since the most recent transmission 
control information was stored in the TS buffer 112a. Then, 
after the third write process is completed, the RTF 
transmission process unit enters a state of waiting for the 
next TS packet. 

At the step S07, the transmission control information 
is stored in the TS buffer 112a. Then, after the 
transmission control information is stored in the TS buffer 
112a, the RTP transmission process unit enters a state of 
waiting for the next TS packet. 

As described above, one of the first, second and 
third write processes is carried out in dependence on 
whether or not the received TS packet includes a PGR field 
and, if the received TS packet includes a PGR field, in 
dependence on the state of setting an RTP packet in the TS 
buffer 112a, The first, second and third write processes 
are explained one after another as follows. 

In the first place, the first write process is 
explained. Fig. 14 shows a flowchart representing the 
processing procedure of the first write process. Fig. 15 is 
a diagram showing the status of an RTP packet set in the TS 
buffer 112a. 
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The first write process represented by the flowchart 
shown in Fig. 14 is activated if the received TS packet does 
not include a PGR field. The flowchart begins with a step 
S41 at which the received TS packet is stored in the TS 
buffer 112a. To be more specific, the received TS packet is 
stored in an area 1124 starting at an address following the 
last address of an area 1125 in which the TS packet 
immediately preceding the received TS packet has been stored. 

Then, at the next step S42, an increment of 188 bytes 
is added to the RTP packet size, which is a field included 
in the transmission control information associated with the 
received TS packet, in order to update the size of the RTP 
packet . 

To put it in detail, the received TS packet 
temporarily stored in the TS temporary register 1112a is 
written into the area 1124 following the area 112 5 for 
storing the TS packet immediately preceding the received TS 
packet as shown in Fig. 15. In addition, the RTP packet 
size included in the transmission control information stored 
in the area 1126 is updated to reflect the fact that the 
received TS packet has been added to the RTP packet. 

In the second place, the second write process is 

63 



SON-2850 (80001-2850) Patent Application No.: 10/717,631 

REDLINE VERSION 

explained. Fig. 16 shows a flowchart representing the 
processing procedure of the second write process. Fig. 17 
is a diagram showing the status of an RTP packet set in the 
TS buffer 112a. 

The second write process represented by the flowchart 
shown in Fig, 16 is activated if the received TS packet 
includes a PGR field and is the first TS packet received 
since transmission control information was stored in the TS 
buffer 112a. That is to say, the second write process 
represented by the flowchart shown in Fig. 16 is activated 
when all preparations to start an operation to set a new RTP 
payload in the TS buffer 112a are done upon completion of 
the operation to set an immediately preceding RTP payload 
including a series of previously received TS packets ending 
with the immediately preceding TS packet. 

The flowchart begins with a step S51 at which the 
received TS packet is stored in the TS buffer 112a. To be 
more specific, the received TS packet is stored in an area 
following the last address of an area, which has been 
reserved in the TS buffer 112a, being allocated to the value 
of the PGR field of this RS packet. The value of the PGR 
field is stored temporarily in the PGR temporary register 

64 



SON-2850 (80001-2850) Patent Application No. : 10/717,631 

REDLINE VERSION 

1113a. 

Then, at the next step S52, the value of the PGR 
field stored temporarily in the PGR temporary register 1113a 
is copied to an area 1123 reserved in the TS buffer 112a, 
being allocated to the value of the PGR field. 

Subsequently, at the next step S53, an increment of 
188 bytes is added to the RTP packet size, which is a field 
included in the transmission control information for the 
received TS packet stored in the TS buffer 112a at the step 
S51, in order to update the size of the RTP packet. 

In such processing, the packet transmission request 
flag included in the transmission control information stored 
in an area 1127 in the TS buffer 112a_j_ as shown in Fig. 17^ 
was set before the second write process is activated. The 
transmission control information stored in the area 1127 is 
associated with the immediately preceding RTP payload. At 
that time, areas 1126 and 1123 are reserved in the TS buffer 
112a in advance, being allocated to the transmission control 
information and the value of the PGR field respectively. 
When the second write process is carried out, the received 
TS packet temporarily stored in the TS temporary register 
1112a is copied to an area 1124 following the last address 
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of the area 1123. In addition, the RTP packet size included 
in the transmission control information stored in the area 
1126 is updated to reflect the fact that the received TS 
packet has been added to the RTP packet. 

In the third place, the third write process is 
explained. Fig. 18 shows a flowchart representing the 
processing procedure of the third write process. Fig. 19 is 
a diagram showing the status of an RTP packet set in the TS 
buffer 112a. 

The third write process represented by the flowchart 
shown in Fig. 18 is activated if the received TS packet 
includes a PGR field and is not the first TS packet received 
since transmission control information was stored in the TS 
buffer 112a. That is to say, the third write process is 
activated in a state wherein a new RTP payload must be set 
by abiding by rule (1) described before. 

The flowchart begins with a step S61 at which the 
received TS packet is stored in the TS buffer 112a. To be 
more specific, the received TS packet is stored in an area 
1124 starting at an address obtained by adding an offset, 
which is equal to the s\im of the length of a PGR field to be 
stored in an area 1123 in the TS buffer 112a and the length 
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of transmission control information to be stored in an area 
1126 in the TS buffer 112a, to the last address of an area 
1125 for storing the immediately preceding TS packet. At 
that time, the value of the PGR field is stored in the PGR 
temporary register 1113a. 

Then, at the next step S62, the value of the PGR 
field stored temporarily in the PGR temporary register 1113a 
is copied to the area 1123 reserved in the DPRAM serving as 
the TS buffer 112a as a portion of the offset added at the 
step S61, being allocated to the value of the PGR field. 

Subsequently, at the next step S63, new transmission 
control information is stored in the area 1126 reserved in 
the TS buffer 112a as a portion of the offset added at the 
step S61, being allocated to the transmission control 
information. 

Then, at the next step S64, the transmission request 
flag included in the transmission control information for 
the immediately preceding RTP payload is set. 

In such a process, the received TS packet temporarily 
stored in the TS temporary register 1112a is copied to the 
area 1124 starting at an address obtained by adding the 
offset described above to the last address of the area 1125 
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for storing the immediately preceding TS packet as shown in 
Fig. 19. In addition, new transmission control information, 
which is associated with the value of the PGR field stored 
in the area 1123 and the received TS packet stored in the 
area 1124, is set in the area 112 6. Finally, the 
transmission request flag included in transmission control 
information is set. The transmission control information 
has been stored in an area 1127 as transmission control 
information for the immediately preceding RTP payload. 

Next, the process of storing transmission control 
information is explained. Fig, 20 shows a flowchart 
representing a processing procedure of the process, which is 
carried out at the step S07 of the flowchart shown in Fig. 
13, to store transmission control information. Fig. 21 is a 
diagram showing the status of information written into the 
TS buffer 112a in the course of the process to store 
transmission control information. 

As shown in the flowchart of Fig. 13, the process of 
storing transmission control information is activated after 
the first or second write process is completed. 

The process of storing transmission control 
information begins with a step S71 at which the transmission 
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control information is referenced to examine the size of the 
RTP packet in order to form a judgment as to whether or not 
the size satisfies a transmission condition. If the size of 
the RTP packet satisfies the transmission condition, the 
flow of the processing procedure goes on to a step S72 . If 
the size of the RTP packet does not satisfy the transmission 
condition, on the other hand, the execution of the process 
of storing transmission control information is ended. 

Then, at the next step S72, a new transmission 
control information field is created in an area 1126 
following an area 1124 used for storing the presently 
received TS packet in the TS buffer 112a as shown in Fig. 21. 

Subsequently, at the next step S73, a PGR field is 
created in an area 1123 following the area 112 6 for the new 
transmission control information field in the TS buffer 112a 
as shown in Fig. 21. 

Then, the flow of the processing procedure goes on to 
a step 874 at which a packet transmission request flag is 
set. The packet transmission request flag is included in 
transmission control information associated with an 
immediately preceding RTP packet, which encloses an 
immediately preceding RTP payload. The immediately 
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preceding RTP payload includes a series of previously 
received TS packets ending with the presently received TS 
packet . 

In such a process, when a transmission size is 
satisfied, transmission control information and a PGR field 
are provided in rQopcctivoly the areas 1126 and 1123_ 
respectively , which follow an RTP payload ending with the 
presently received TS packet stored in the area 1124 as 
shown in Fig. 21. The PGR field is provided in the area 
1123 by copying the immediately preceding PGR field stored 
in an area 1121. Then, as preparations for setting the next 
RTP payload are put in a state of completion, a packet 
transmission request flag included in transmission control 
information stored in an area 1127 is set. 

Next, a transmission process carried out by the 
packet synthesizer 1132 is explained. Fig. 22 shows a 
flowchart representing the processing procedure of the 
transmission process. Fig. 23 is a diagram showing the 
state of the TS buffer 112a in the transmission process. 

The flowchart begins with a step S81 at which the 
packet transmission request flag included in transmission 
control information is polled at predetermined intervals. 
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Then, the flow of the transmission process goes on to a step 
S82 to determine whether or not the packet transmission 
request flag has been set. If the packet transmission 
request flag has not been set, the flow of the transmission 
process goes back to the step S81 to repeat the polling 
operation- The packet transmission request flag is polled 
repeatedly till the flag is set. As the packet transmission 
request flag has been set, the flow of the transmission 
process goes on to a step S83- 

At the step S83, the size of the RTP packet is 
fetched from the transmission control information. Then, at 
the next step S84, the value of the PGR field is read out. 
Subsequently, at the next step S85, other RTP header 
information is fetched from the RTP header register. 

Then, at the next step S86, an RTP header is created 
and supplied to a layer at a lower level (i.e. the network 
device 330) . 

Subsequently, at the next step S87, the RTP packet 
having the RTP packet size is fetched from the TS buffer 
112a and supplied to the layer at a lower level as an RTP 
payload. Then, the flow of the transmission process goes " 
back to the step S81 to monitor the next packet transmission 



SON-2850 (80001-2850) Patent Application No. : 10/717,631 

REDLINE VERSION 

request flag. 

As described above, transmission control information, 
the value of a PGR field and TS packets are set in the TS 
buffer 112a and, in dependence of the setting status, an RTP 
packet created on the basis of the transmission control 
information, the value of the PGR field and the TS packets 
is transferred to the layer at a lower level. The TS buffer 
112a is typically implemented as a ring-shaped buffer. In 
such a process, the transmission control information is 
fetched from a start-tijne address in the ring-shaped buffer 
as shown in Fig. 23. If the packet transmission request 
flag included in the transmission control information has 
been set, indicating that a request for a transmission of an 
RTP packet has been made, an RTP header of the RTP packet is 
created by using the PGR field following the transmission 
control information. Then, TS packets stored in an area 
following the PGR field are read out and transferred to the 
layer at a lower level sequentially. As the operation to 
transfer the TS packets is finished, an address stored in a 
pointer register is set at a value pointing to an end-time 
address at which the next transmission control information 
is stored. 
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As described above, in the fifth embodiment, values 
of the PGR field and pieces of the transmission control 
information are not stored in registers. Thus, the number 
of such registers can be reduced, making it possible to 
provide a circuit with a compact size. In particular, it is 
not necessary to add the number of registers in use even if 
the number of TS packets to be enclosed in an RTP packet 
increases . 

In addition, since a dual-port RAM is employed as 
the TS buffer 112a, the A/V data checker 111 -serving as a 
functional block for generating an RTP packet can be divided 
into a codec-side block and a clock domain. Thus, a circuit 
such as a clock transfer unit is not required. 

While preferred embodiments of the present invention 
have been described using specific terms, such description 
is for illustrative purposes only, and it is to be 
understood that changes and variations may be made without 
departing from the spirit or scope of the following claims. 
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